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(54) System and method for calibration of display system with linear array modulator 



(57) A system and method for calibration of a display 
system with a linear modulator array that includes: a 
light source (70); a linear array of light modulating de- 
vices (85) driven by a controller; a projection lens sys- 
tem (75) that creates a line image of the linear array on 
a screen; a scanning mirror (77) that sweeps the line 
image across the screen to form a two-dimensional 



scene; and an image sensor (50) containing an area ar- 
ray of light sensitive detectors that captures image in- 
tensity data from the two-dimensional scene and trans- 
mits the image intensity data to the controller, wherein 
the controller (80) converts the image intensity data into 
a one-dimensional array of correction factors for the lin- 
ear array of light modulating devices. 
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Description 

[0001] The present invention relates to the calibration 
of a display system employing a linear array of light mod- 
ulators, and more particularly to a display system with 5 
a linear array of conformal GEMS devices and an image 
sensor for uniformity calibration 
[0002] Many display systems, including large screen 
TVs, conference room projectors, and digital cinema 
projectors generate an output image by employing a 
spatial light modulator that receives light from a light 
source to impart image information on a uniform light 
field. At present in such display systems, the light source 
is typically a white light lamp and the spatial light mod- 
ulator is typically an area array containing liquid crystal 
devices or micromirror devices. Alternative projection 
display architectures, with one or more laser light sourc- 
es and spatial light modulators that are linear arrays of 
electromechanical grating devices, have been demon- 
strated and show much promise for the future. For a dis- 
play system with a linear array architecture, a scanning 
mirror is used to generate a two-dimensional scene from 
a projected one-dimensional image of the linear array. 
[0003] A system and method for calibrating a display 
system with a linear array of Grating Light Valves (GLV) 
was published by R.W. Corrigan et al. in "Calibration of 
a Scanned Linear Grating Light Valve Projection Sys- 
tem," SID '99 Digest, pp. 220- 223. The calibration meth- 
od described by Corrigan uses a single detector to cal- 
ibrate an entire linear GLV array. The correction factors 
for each device on the array are obtained by focusing 
the output of the entire array on the detector, turning on 
the devices one by one, and measuring the resulting 
light output. In this device-by-device approach, the en- 
tire background signal of the array is measured in addi- 
tion to the light output of a single device. If the back- 
ground signal is sufficiently high, there are problems 
with the signal-to-noise ratio in determining the correc- 
tion factors needed to produce a uniform flat field. This 
signal-to-noise ratio problem is especially pronounced 
in calibrating the flat field of a low intensity gray level. 
As an example, in the calibration of the 5% intensity flat- 
field for a GLV array with 1000 devices and a contrast 
ratio of 1000:1, the background signal is 20 times larger 
than the output intensity from a single device. An addi- 
tional disadvantage is that a device-by-device approach 
does not readily produce accurate calibration factors for 
a uniform flat field because the outputs of adjacent de- 
vices may not add linearly (for example, the output in- 
tensity measured when two adjacent devices are turned 
on is not equal to twice the intensity of a single device). 
This output non-linearity is due to changes in the diffrac- 
tion pattern that occur when adjacent devices are turned 
on. The diffraction effects are even more pronounced 
when using light sources with high coherence, such as 
lasers. A third disadvantage is that the device-by-device 
approach does not directly calibrate the flat field on the 
screen as seen by a viewer. 



[0004] Calibration systems for displays with two-di- 
mensional modulator arrays have been disclosed that 
sample the output and generate correction factors to im- 
prove image quality. Specifically. U.S. Patent No. 
5,386,253, entitled "Projection Video Display Systems," 
by Fielding, January 31,1 995, discloses the use of one 
or more point detectors that measure light reflected from 
the screen to determine the appropriate correction fac- 
tor. The signal-to-noise ratio problem mentioned earlier 
becomes even more pronounced for this system. An al- 
ternative approach, described in U.S. Patent No. 
4,868,668, entitled "System And Method For Image Ad- 
justment In An Optical Projection System," by Tavernet- 
ti, September 19, 1989, uses a two-dimensional CCD 
array to determine correction factors by sampling a por- 
tion of the light emerging from the two-dimensional mod- 
ulator array. This particular approach cannot be used in 
a display system with a linear array modulator without 
the addition of data processing electronics to generate 
the appropriate correction factors for the linear array 
modulator from the two-dimensional CCD data. 
[0005] A significant problem with display systems that 
employ linear array modulators is that even a slight non- 
uniformity in the projected one-dimensional image pro- 
duces parallel bands in the two-dimensional scene that 
are noticeable and objectionable to many viewers. A cal- 
ibration system is required to reduce these objectiona- 
ble bands in the two-dimensional scene. There is a 
need, therefore, for an improved calibration system for 
a display with a scanned linear array modulator that cor- 
rects image banding and avoids the problems noted 
above. 

[0006] The above need is met according to the 
present invention by providing a system and method for 
calibration of a display system with a linear modulator 
array that includes: a light source; a linear array of light 
modulating devices driven by a controller; a projection 
lens system that creates a line image of the linear array 
on a screen; a scanning mirror that sweeps the line im- 
age across the screen to form a two-dimensional scene; 
and an image sensor containing an area array of light 
sensitive detectors that captures image intensity data 
from the two-dimensional scene and transmits the im- 
age intensity data to the controller, wherein the control- 
ler converts the image intensity data into a one-dimen- 
sional array of correction factors for the linear array of 
light modulating devices. 

Fig. 1 illustrates a projection display system that 
contains a linear array modulator and an image sen- 
sor for calibration of the present invention; 
Fig. 2 illustrates an illuminated linear array of con- 
formal GEMS devices for the present invention; 
Fig. 3 illustrates the formation of a two-dimensional 
scene by scanning the projected one-dimensional 
image of a linear array modulator for the present 
invention; 

Fig. 4A is a rendition of a photograph of an uncali- 
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brated flat field scene showing horizontal banding 
without the use of the present invention; 
Fig. 4B is a rendition of a photograph of a calibrated 
flat field scene after use of the present invention; 
Fig. 5 illustrates an alternate embodiment of a pro- 
jection display system with calibration; 
Fig. 6 illustrates a projection display system with 
calibration that produces simultaneous RGB for the 
present invention; 

Fig. 7 is a flow diagram illustrating the calibration 
method of the present invention; and 
Fig. 8 is a flow diagram illustrating an alternative cal- 
ibration method of the present invention. 

[0007] In the following description, embodiments of 
the present invention include a software program. 
Those skilled in the art will readily recognize that the 
equivalent of such software may also be constructed in 
hardware. Because image manipulation algorithms and 
systems are well known, the present description will be 
directed in particular to algorithms and systems forming 
part of, or cooperating more directly with, the method in 
accordance with the present invention. Other aspects of 
such algorithms and systems, and hardware and/or soft- 
ware for producing and otherwise processing the image 
signals involved therewith, not specifically shown or de- 
scribed herein may be selected from such systems, al- 
gorithms, components, and elements known in the art. 
Given the description as set forth in the following spec- 
ification, all software implementation thereof is conven- 
tional and within the ordinary skill in such arts. 
[0008] Figure 1 shows a display system 48 containing 
a spatial light modulator with a linear array 85 of individ- 
ually operable devices. Light is emitted from a source 
70 and conditioned by a pair of lenses 72 and 74 before 
hitting a turning mirror 82 and illuminating the linear ar- 
ray 85. The display system of Fig. 1 forms an entire flick- 
er-free two-dimensional scene on the screen 90 from a 
one-dimensional linear array modulator. The devices of 
the linear array 85 should therefore be capable of rapidly 
modulating incident light to produce multiple lines of pix- 
els with gray levels. Electromechanical grating devices 
are the only welldeveloped spatial and temporal light 
modulators that, at the present time, can provide the re- 
quired response times at low cost. More specifically, the 
preferred modulators are either the conformal Grating 
EiectroMechanical System (GEMS) devices made by 
Eastman Kodak Company (see U.S. Patent No. 
6,307,663, entitled "Spatial Light Modulator With Con- 
formal Grating Device," by Kowarz. October 23, 2001 
and European Patent Application No. 01200128.5, en- 
titled; "Method For Manufacturing A Mechanical Confor- 
mal Grating Device," by Kowarz, et al., filed January 15, 
2001 ); or the Grating Light Valves (GLV) made by Silicon 
Light Machines, disclosed in U.S. Patent No. 5,982,553, 
entitled, "Display Device Incorporating One-Dimension- 
al Grating Light-Valve Array," by Bloom et al., November 
9, 1999. As depicted in Fig. 1, the linear array 85 con- 



tains conformal GEMS devices. A more detailed de- 
scription of display system 48 based on scanning linear 
arrays of conformal GEMS devices can be found in Eu- 
ropean Patent Application No. 01203551.5, 
5 " Electromechanical Grating Display System with Spa- 
tially Separate Light Beams," filed Sept. 19, 2001 by 
Kowarz, Brazas and Phalen. 

[0009] In Fig. 1 , the controller 80 selectively activates 
the linear array 85 to obtain the desired pixel pattern for 

to a given line of a two-dimensional scene. If a particular 
conformal GEMS device is not actuated, it reflects the 
incident light beam primarily into the 0th order light 
beam, which is directed back towards the source 70 by 
the turning mirror 82. If the device is actuated, it diffracts 

75 the incident light beams primarily into +2 nd ,+1 st , -1 st and 
-2 nd order light beams. These diffracted beams pass 
around the turning mirror 82 and are projected on the 
screen 90 by the projection lens system 75. The scan- 
ning mirror 77 sweeps the line image across the screen 

20 90 to form the two-dimensional scene. The controller 80 
provides synchronization between the sweep of the 
scanning mirror 77 and the data stream that provides 
the scene content. 

[0010] Figure 2 depicts a linear array 85 of conformal 

25 GEMS devices illuminated by a line of light 88. For illus- 
tration purposes, there are 1 080 individually operable 
conformal GEMS devices shown, labeled P1 through 
P1 080. Figure 3 is a view facing the screen 90 showing 
the formation of the two-dimensional scene. In this illus- 

30 tration, HDTV resolution is obtained by scanning the im- 
age of the linear array 85 of 1080 conformal GEMS de- 
vices to generate 1 920 sequential lines, thereby produc- 
ing a scene with 1080 by 1920 pixels. 
[0011] The projection display system of Fig. 1 gener- 

35 ates gray levels in the scene from code values in the 
data stream. Gray levels are obtained by using a look- 
up-table (LUT) to determine the required actuation volt- 
age waveform for the devices of the linear array 85 
based on the code value in the data stream. For confor- 

40 mal GEMS devices that generate gray levels through 
pulse width modulation, the LUT provides conversion 
between code values in the data stream and pulse-width 
modulated voltage pulses appropriate for actuating the 
devices. In addition, calibration of non-uniformities is 

4 5 possible if the LUT also allows a different correspond- 
ence between code values and gray levels for each of 
the devices of the linear array 85. 
[0012] The process of generating a two-dimensional 
scene by scanning a linear array can lead to image 

50 banding, which can be very noticeable because of the 
sensitivity of the human visual response to such arti- 
facts. These bands can arise from non-uniformities in 
the illumination beam and projection optics, and from 
variations of the device response along the array. Figure 

55 4A is a rendition of a photograph taken from a prototype 
projection display system with an uncalibrated flat field 
projected on a screen 90. This prototype system con- 
tains a linear array with 256 conformal GEMS devices. 
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The uncalibrated flat field is generated by sending a data 
stream to the controller 80 with equal code values for 
each device on the linear array 85. The two-dimensional 
scene is formed by reimaging the non-zero diffracted or- 
ders of the linear array onto the screen 90 and using a 
galvanometer to sweep the line image across the screen 
90. Parallel horizontal banding artifacts are clearly visi- 
ble in the uncalibrated flat field along the scan direction. 
The bands are generated by the vertical non-uniformity 
that is present in the line image of the uncalibrated linear 
array. 

[0013] To obtain correction factors for creating a uni- 
form calibrated flat field scene, an image sensor 50 is 
added to the display system of Fig. 1, For calibration, 
the controller 80 turns on the linear array 85 so that, in- 
itially, an uncalibrated flat field scene is projected on the 
screen 90. The image sensor 50 is used to capture an 
image of the uncalibrated flat field. As drawn in Fig. 1, 
the image sensor is a two-dimensional area array of light 
sensitive detectors incorporated into a digital camera. A 
precise estimate of the required correction factors re- 
quires an image sensor with a resolution along the de- 
vice axis (vertical axis in Figs. 3, 4A and 4B) larger than 
the number of devices on the linear array 85. However, 
for lower frequency banding artifacts, such as those 
caused by illumination non-uniformity, reasonable cor- 
rection can be obtained with lower sensor resolution. 
The image intensity data from the image sensor 50 is 
processed by the controller 80 to generate the appropri- 
ate correction factors for each device on the linear array 
85. These correction factors are used to modify the LUT 
for converting code values in the data stream to actua- 
tion voltage waveforms for each device, thereby adjust- 
ing the gray levels. If necessary, the calibration steps 
can be repeated to optimize the uniformity of the flat field 
scene. This calibration process can be performed for ad- 
ditional gray levels of the flat field scene to assure uni- 
formity throughout the gray scale needed for image dis- 
play. 

[0014] Fig. 4B is a rendition of a photograph of the 
calibrated flat field scene (same system as Fig. 4A) after 
repeating the above calibration procedure several 
times. The horizontal banding visible in Fig. 4A is elim- 
inated by calibration. The conformal GEMS array in this 
system produces gray levels through pulse width mod- 
ulation. A particular gray level is produced by actuating 
the devices for a certain portion of the line time used to 
generate a vertical line of pixels. The correction factors 
are used to modify the LUT assignment for each device 
of the linear array between input code values and the 
pulse width of the actuation voltages. 
[0015] Calibration requires processing the image in- 
tensity data of the flat field to obtain a correction factor 
for each device of the linear array 85. One scheme for 
generating these correction factors is to average the im- 
age intensity data along the horizontal scan direction, 
with correction for any known skew or distortion created 
by the display system, camera system, or viewing con- 



ditions. The horizontal averaging reduces the two-di- 
mensional image intensity data to a one-dimensional ar- 
ray of values corresponding to the average horizontal 
intensity. The averaging process improves signal-to- 
5 noise ratio for determining the appropriate correction 
factor. Noise from several different sources can be sup- 
pressed in this manner, including speckle in the project- 
ed image, local non-uniformity in the screen, and noise 
in the image sensor. As was implied earlier, for most sys- 
10 terns the number of data values in the one-dimensional 
array of average horizontal intensity will not necessarily 
match the number of modulating devices on the linear 
array 85. Therefore, the one-dimensional data set 
needs to be resampled'to obtain a correction factor for 
15 each device of the linear array 85. 

[0016] The above embodiment overcomes several 
limitations of the prior art relating to the calibration of a 
display system with a linear array modulator: 1) it pro- 
vides a high signal-to-noise ratio for calibrating even low 
20 intensity gray levels; 2) it performs calibration on the en- 
tire flat field scene simultaneously, thereby avoiding any 
non-linear effects between adjacent pixels; and 3) it di- 
rectly calibrates the scene on the screen as viewed by 
the audience. 

25 [0017] It should be noted that alternate schemes for 
measuring the required calibration factors are within the 
scope of the present invention. Figure 5 illustrates an 
alternate embodiment in which the calibration image is 
formed internally within the display system 92. A beam 
30 splitter plate 56 is used to redirect a small portion of the 
diffracted light 73 through an image-forming lens 54 that 
produces an image for calibration directly on the image 
sensor 52. The image sensor 52 in Fig. 5 is preferably 
an area array of light sensitive sensors that simultane- 
35 ously captures the entire image intensity data for cali- 
bration. However, as is well-known to those skilled in the 
art, a linear array of sensors with timesequential readout 
can be used to replace an area array of sensors. 
[0018] Figure 6 illustrates implementation of a display 
40 system 93 that produces RGB simultaneously. The red, 
green and blue channels each have their own light 
sources (70r, 70g, and 70b), lenses (72r, 72g, 72b : 74r, 
74g, and 74b), turning mirrors (82r, 82g, and 82b) and 
linear arrays of light modulating devices (85r, 85g, and 
45 85b). A color combining cube 100 is used to direct the 
red, green and blue outputs through the projection lens 
system 75 and onto the screen 90. Using the approach 
discussed earlier, the image sensor 50 is used to cap- 
ture the image intensity data needed to generate the 
50 correction factors required for uniformity calibration of 
each of the three colors. For a monochrome image sen- 
sor 50, the three colors are calibrated one at a time. For 
an image sensor 50 with an RGB color filter array, the 
calibration may be performed simultaneously for all 
55 three colors. The correction factors are used to modify 
the LUT assignment of the gray levels for each of the 
three linear arrays (85r, 85g, and 85b). The image in- 
tensity data can also be used to adjust the LUT assign- 
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ments of the red, green and blue images to obtain a de- 
sired color balance. 

[0019] In the RGB display system of Fig. 6, precise 
pixel registration is needed between the three linear ar- 
rays to obtain high quality images. The image sensor 50 5 
can be used to capture offset factors for calibration of 
pixel registration along the horizontal direction. To per- 
form offset calibration, an offset test pattern, preferably 
consisting of vertical lines with high spatial frequency, is 
projected on the screen. The offset factors are deter- 10 
mined by comparing the relative alignment of the three 
RGB images captured by the image sensor 50. Correc- 
tion then involves a timing delay or advance between 
the data streams of the three linear arrays 85r, 85g, and 
85b. The correction eliminates horizontal misalignment '5 
between the red, green and blue pixels on the screen 90. 
[0020] The purpose of the uniformity calibration proc- 
ess used in the projection display systems of Figs. 1 , 5, 
and 6 is modification of the grayscale LUT used to con- 
vert code values in the data stream to actuation voltage 20 
waveforms for the modulating devices on the linear ar- 
ray 85. The calibration process assures that a data 
stream with equal code values for each modulating de- 
vice will produce a uniform flat field scene on the screen 
90 and that a range of code values will produce the de- 25 
sired range of gray levels. Referring to Fig. 7, flow dia- 
gram 700, a method for calibrating a projection display 
having a scanned linear array modulator involves sev- 
eral operating steps. To start the calibration, operation 
705 initializes the gray scale LUT. The appropriate initial 30 
values depend on the particulartype of linear array mod- 
ulator in the projection display. Forthe conformal GEMS 
device, a linear relation between input code values and 
actuation voltage pulse widths has been found to work 
well during calibration. In operation 710, a flat field 35 
scene is displayed on the screen. To determine the level 
of non-uniformity, operation 720 causes image intensity 
data to be captured from the nominally flat field scene. 
The correction factors needed to generate a uniform flat 
field scene are calculated by appropriately processing 40 
the two-dimensional image intensity data. For example; 
in operations 730 and 740, this data processing is ac- 
complished by averaging the image intensity data along 
the scan direction and determining the required correc- 
tion factors for the gray scale LUT from the scan-aver- 45 
aged data. A re-sampling of the scan-averaged image 
intensity data may also be required (not shown). In any 
event, the subsequent operation 750 determines wheth- 
er the flat field scene is sufficiently well calibrated. A uni- 
formity metric is needed for this decision : such as the so 
standard deviation of the newly calculated correction 
factors. If the standard deviation is below a certain 
threshold, the calibration procedure is terminated. Oth- 
erwise, operation 760 modifies the gray scale LUT using 
the correction factors and operations 710-750 are re- 55 
peated. The calibration process is iterated until the flat 
field scene is sufficiently uniform as determined by the 
uniformity metric. 



[0021] Figure 8, flow diagram 800 s shows an alterna- 
tive method for calibrating a projection display contain- 
ing a scanned linear array modulator. Unlike the previ- 
ous method, this approach does not require projection 
of a flat field scene. It can also be applied during the 
projection of scenes with real image content. The gray 
scale LUT is first initialized by operation 805. A data 
stream, continuously fed into the display system (oper- 
ation 807) : is used for two purposes: to display scenes 
on the screen (operation 81 0) and to provide a reference 
for calculating correction factors (operation 870). The 
scenes may contain images designed specifically for 
uniformity calibration or may contain ordinary motion im- 
ages for display to a viewing audience. Operations 820 
and 830 cause image intensity data to be captured and 
averaged along the scan direction. At the same time, 
operation 870 calculates the average expected intensity 
from the data stream. To calculate the required correc- 
tion factors, operation 840 compares the scan-averaged 
image intensity data to the average expected intensity. 
The standard deviation of the correction factors, or an- 
other suitable metric, is used by operation 850 to deter- 
mine whether the gray scale LUT should be adjusted by 
performing operation 860. The method can be iterated 
as needed. 

Claims 

1. A calibrated projection display system, comprising: 

a) a light source; 

b) a linear array of light modulating devices 
driven by a controller; 

c) a projection lens system that creates a line 
image of the linear array on a screen; 

d) a scanning mirror that sweeps the line image 
across the screen to form a two-dimensional 
scene; and 

e) an image sensor containing an area array of 
light sensitive detectors that captures image in- 
tensity data from the two-dimensional scene 
and transmits the image intensity data to the 
controller, wherein the controller converts the 
image intensity data into a one-dimensional ar- 
ray of correction factors for the linear array of 
light modulating devices. 

2. The calibrated projection display system as claimed 
in claim 1 wherein the conversion of image intensity 
data into a one-dimensional array of correction fac- 
tors is accomplished by averaging the image inten- 
sity data along a scan direction corresponding to the 
scanning mirror. 

3. The calibrated projection display system as claimed 
in claim 1 wherein the linear array of light modulat- 
ing devices comprises electromechanical grating 
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devices. 

4. The calibrated projection display system as claimed 
in claim 1 wherein the image intensity data is ob- 
tained from a flat field scene on the screen. 

5. The calibrated projection display system as claimed 
in claim 1 wherein the image intensity data is ob- 
tained from at least two flat field scenes that have 
different gray levels. 

6. The calibrated projection display system as claimed 
in claim 1 wherein the calibration projection display 
system is a three color system and the image inten- 
sity data includes corresponding image intensity 
data sets for each color. 

7. A calibrated projection display system having simul- 
taneous color output, comprising: 

a) at least two light sources with different color 
spectra; 

b) at least two linear arrays of light modulating 
devices driven by a controller; 

c) a projection lens system that creates line im- 
ages of the at least two linear arrays on a 
screen; 

d) a scanning mirror that sweeps the line imag- 
es across the screen to form a two-dimensional 
scene; and 

e) an image sensor containing an area array of 
light sensitive detectors that captures image in- 
tensity data from the two-dimensional scene 
and transmits the image intensity data to the 
controller, wherein the controller converts the 
image intensity data into one-dimensional ar- 
rays of correction factors for the at least two lin- 
ear arrays of light modulating devices. 



10 



b) capturing image intensity data from the flat 
field scene with an image sensor; 

c) converting the image intensity data into a 
one-dimensional array of correction factors for 
the linear array modulator; and 

d) repeating the above steps as necessary to 
obtain a calibrated flat field scene. 

11. The method claimed in claim 10 wherein the step 
of converting the image intensity data into a one- 
dimensional array of correction factors involves av- 
eraging the image intensity data along a scan direc- 
tion corresponding to a scanning mirror. 

12. The method claimed in claim 11 wherein the proc- 
ess of generating the one-dimensional array of cor- 
rection factors includes re-sampling of the aver- 
aged image intensity data. 



20 1 3. The method claimed in claim 1 0 wherein the correc- 
tion factors are used to modify a look-up-table used 
to generate gray levels. 



15 



25 



14. The method claimed in claim 13 wherein the gray 
levels are obtained by pulse width modulation. 



15. 



30 



35 



The method claimed in claim 1 0 wherein the projec- 
tion display is a color projection display, and the cor- 
rection factors are adjusted to achieve color bal- 
ance. 



The calibrated projection display system having si- 40 
multaneous color output claimed in claim 7, wherein 
the image intensity data is obtained from a two-di- 
mensional scene containing an offset test pattern 
and the correction factors include timing delays be- 
tween the at least two linear arrays of light modu- 45 
lating devices. 



9. The calibrated projection display system having si- 
multaneous color output claimed in claim 7, wherein 
the controller adjusts the correction factors of the at 
least two linear arrays of light modulating devices 
to obtain color balance of the two-dimensional 
scene. 

10. A method for calibrating a projection display having 
a linear array modulator, comprising the steps of: 



50 



55 



a) displaying a flat field scene upon a screen; 
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